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ABSTRACT 

Background Although respiratory symptoms are 
characteristic features of COPD, there is no standardised 
method for quantifying their severity in stable disease. 
Objective To evaluate the EXACT-Respiratory Symptom 
(E-RS) measure, a daily diary comprising 11 of the 14 
items in the Exacerbations of Chronic Pulmonary Disease 
Tool (EXACT). 

Methods Qualitative: patient focus group and 
interviews to address content validity. Quantitative: 
secondary data analyses to test reliability and validity. 
Results Qualitative: n=84; mean (SD) age 65 (10) 
years, FEV, 1 .2(0.4) L; 44% male. Subject descriptions 
of their respiratory symptoms were consistent with E-RS 
content and structure. Quantitative: n=1 88; mean (SD) 
age 66 (10) years, FEV, 1.2(0.5) L; 50% male. Factor 
analysis (FA) showed 3 subscales: RS-Breathlessness, 
RS-Cough & Sputum, and RS-Chest Symptoms; second- 
order FA supported a general factor and total score. 
Reliability (total and subscales): 0.88, 0.86, 0.73, 0.81; 
2-day test-retest ICC: 0.90, 0.86, 0.87, 0.82, 
respectively. Validity: Total scores correlated significantly 
(p < 0.0001) with SGRQ Total (r=0.75), Symptoms 
(r=0.66), Activity (r=0.57), Impact (r=0.70) scores; 
subscale correlations were also significant (r=0.26, 
p < 0.05 (RS-Chest Symptoms with Activity) to r=0.69, 
p< 0.0001 (RS-Cough & Sputum with Symptoms). 
RS-Breathlessness correlated with rescue medication use 
(r=0.32, p< 0.0001), clinician-reported mMRC (r=0.33, 
p< 0.0001), and FEV,% predicted (r=-0.17, p < 0.05). 
E-RS scores differentiated groups based on chronic 
bronchitis diagnosis (p < 0.01-0.001), smoking 
status (p< 0.05-0.001), and rescue medication use 
(p< 0.05-0.0001). 

Conclusions Results suggest the RS-Total is a reliable 
and valid instrument for evaluating respiratory symptom 
severity in stable COPD. Further study of sensitivity to 
change is warranted. 
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INTRODUCTION 

COPD is a progressive disease characterised by per- 
sistent airflow limitation with varying degrees of 
airway wall narrowing, inflammation and emphy- 
sema. Respiratory symptoms, including breathless- 
ness, cough and sputum production, are 
characteristic features of the disease and have sig- 
nificant adverse effects on patient functioning and 
quality of life. 1-4 Although spirometric measures 
are useful for diagnosis and evaluating change in 
lung function, they do not capture symptom sever- 
ity or variability; weak correlations between lung 
function and symptoms show they cannot be used 



Key messages 



What is the key question? 

► Is there a standardised, reliable and valid diary 
to evaluate daily respiratory symptoms in 
clinical studies of stable COPD? 

What is the bottom line? 

► Yes, the E-RS. 

Why read on? 

► This paper presents methods and results of two 
studies showing that RS-Total and subscale 
scores (RS-Breathlessness, RS-Cough & Sputum, 
RS-Chest Symptoms) have content validity and 
are reliable and valid in stable patients with 
COPD. 



as proxies for one another. 5-9 Because respiratory 
symptoms are patient-experienced, it is important 
to measure this outcome directly, through a patient- 
reported outcome (PRO) instrument. 

To date, there is no standardised method for 
evaluating respiratory symptoms of stable COPD 
with a documented development programme con- 
sistent with good research practices 10 11 and the 
Food and Drug Administration (FDA) PRO 
Guidance. 12 Dyspnoea is the most frequently 
assessed symptom, often measured with the 
Baseline/Transition Dyspnea Index, 13 or modified 
Medical Research Council Dyspnea Scale (mMRC). 
Health-status measures with symptom components 
include the St George's Respiratory Questionnaire 
(SGRQ), 14 Chronic Respiratory Disease 
Questionnaire, 15 Clinical COPD Questionnaire, 16 
and COPD Assessment Test. 17 These questionnaires 
are completed by subjects intermittently using 
varied recall periods (eg, since the last visit, past 
month, previous week, or now). 

An alternative to periodic symptom assessment is 
a patient-completed diary, capturing symptoms 
each day. This approach is necessary for studies 
examining the temporal and dynamic nature of 
respiratory symptoms, including their relationship 
to other variables such as activity, stress, environ- 
mental conditions and rescue medication use. In 
clinical trials, diaries can be used to evaluate time 
to symptomatic improvement and/or magnitude 
and persistence of change over the treatment 
period. Regulatory agencies have expressed interest 
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in electronic daily symptom assessments in pharmaceutical 
trials, with their reduced recall bias and technology enabled 
compliance monitoring. 12 18 One diary, the Breathlessness, 
Cough and Sputum Scale, has shown evidence of reliability, val- 
idity and responsiveness. 19 20 However, it is limited to three 
items, and its development was not based on qualitative data 
from the target population, raising concerns about content val- 
idity. 10 " 12 

The Exacerbations of Chronic Pulmonary Disease Tool 
(EXACT)-Respiratory Symptoms (RS) (E-RS) was designed to 
meet the need for a standardised respiratory symptom diary 
with a development history consistent with good research prac- 
tices and FDA PRO requirements. The E-RS uses 11 respiratory 
symptom items from the 14-item EXACT, 2 1-24 offering efficien- 
cies for investigators and subjects by permitting two validated 
uses for one diary: (1) assessment of COPD exacerbations using 
the EXACT total score 1-24 ; (2) quantification of respiratory 
symptoms in stable COPD using RS-Total and subscale scores. 

This paper describes the methods and results of research to 
assess content validity, reliability and validity of the E-RS in 
patients with stable COPD. 

MATERIALS AND METHODS 

The research was conducted in two phases. Phase I addressed 
content validity through qualitative research methods. Phase II 
tested score reliability and validity using an existing dataset. 23 
All data were gathered in accordance with the amended 
Declaration of Helsinki, with study protocols approved by an 
independent institutional review board (IRB) and all participants 
providing written informed consent prior to data collection 
(Essex IRB, ID# A2-3864, A2-3864B; Ethical Review 
Committee, ID# 472-05-09). 

In each phase, study participants were recruited from pul- 
monary and primary care clinics across the USA using inclusion 
criteria similar to those used in pharmaceutical trials: >40 years 
of age; diagnosis of stable COPD; emphysema or chronic bron- 
chitis; and >10 pack-year smoking history. Exclusion criteria: 
medical diagnosis of asthma without postbronchodilator airway 
obstruction; acute congestive heart failure or unstable angina, 
bronchiectasis, lung cancer, or tuberculosis; or treatment for 
respiratory infection or pneumonia within the past 60 days. 
Phase-specific inclusion/exclusion criteria and methods are 
described below. Following enrolment and consent, each site 
provided clinical information related to the participant's diagno- 
sis, pulmonary function and clinician rating of disease severity. 

Phase I: qualitative: content validity 

A two-step process was used to assess and document the extent 
to which the items comprising the E-RS adequately and accur- 
ately reflect respiratory symptoms of COPD in a stable state. 
Methods are outlined below, with details provided in the online 
supplementary appendix. 

Stage 1 : secondary analyses of existing qualitative data 
Qualitative analyses were performed on data gathered during 
the development of the EXACT, 21 that is, data from focus 
groups and interviews with patients with COPD and a history 
of a clinic visit or hospitalisation for exacerbation in the previ- 
ous 6 months (n = 63). The purpose of the original study was to 
characterise COPD exacerbations from the patient's perspective. 
The data included participant descriptions of the nature and 
severity of symptoms during a stable state presented as part of 
their characterisations of COPD and/or to facilitate descriptions 
of exacerbations, that is, relative to their stable state. 



Stage 2: new focus groups 

Additional focus groups were conducted in a new sample 
of clinically stable patients (n=21), that is, exacerbation-free 
for 12 months. The purpose of Stage 2 was to determine if 
there were new insights or information related to respiratory 
symptoms in stable COPD not discussed by patients with an 
exacerbation history and to ensure that saturation had been 
reached. 

Each focus group was led by an experienced study team 
member using a semistructured discussion guide to elicit infor- 
mation on patient perspectives of respiratory symptoms. To 
characterise the sample, participants completed the mMRC 
Dyspnea Scale, 25 the SGRQ for COPD (SGRQ-C), 26 and a 
sociodemographic questionnaire. 

Analyses 

Descriptive statistics were used to characterise the sample. 
Atlas.ti 5.0 facilitated thematic analyses of the qualitative data. 
For each stage of analysis, symptomatic themes were sum- 
marised in a saturation grid and mapped to the respiratory 
symptom items in the EXACT to determine the extent to 
which this subset of items, named the E-RS, would adequately 
capture respiratory symptoms in stable disease. Patient under- 
standing of instructions, items, and response categories was 
addressed using cognitive interviewing methodology during 
EXACT development. 21 

Phase II: quantitative: score reliability and validity 

Secondary analyses were performed on a subset of data from a 
previously published prospective observational study used to 
develop the EXACT. 23 Specifically, data from the stable control 
sample (n = 188) were used. These patients had no history of 
treatment for exacerbation in the preceding 60 days and were 
considered clinically stable on enrolment. Subjects were 
recruited through clinical sites in over 20 states across the USA. 

Measures 

All participants completed the SGRQ-C and sociodemographic 
forms during the enrolment clinic visit; site staff provided clin- 
ician ratings of patient dyspnoea (mMRC) and disease severity, 
and results of the most recent stable-state spirometry. Each 
subject completed an eDiary for the ensuing 7 days that 
included EXACT candidate items, rescue medication use and 
global ratings of change. 23 

Statistical analyses 

Analyses were prespecified in a statistical analysis plan com- 
pleted following Phase I. Because the intent was to evaluate 
the performance properties of the E-RS as a daily diary, ana- 
lyses were conducted with data from Day 1, the same day 
clinic data were gathered, unless otherwise specified. Item-level 
analyses included measures of central tendency, floor and 
ceiling effects, item-total correlations, item response frequen- 
cies and interitem correlations. Confirmatory (CFA), explora- 
tory (EFA), and second-order factor analyses were performed 
to evaluate the structure of the measure and develop the 
scoring algorithms. 

Internal consistency was assessed using Cronbach's a, with a 
target value of greater than 0.70, to make the instrument suit- 
able for use in clinical trials. 27 Two-day test-retest reliability was 
evaluated for consecutive days (Days 1-2; 2-3; 3-4, etc.), with 
data from patients reporting no change in lung condition on the 
daily global assessment question, and Days 1 and 7 in all 



444 



Leidy NK, etal. Thorax 2014;69:443-449. doi:1 0.1 1 36/thoraxjnl-201 3-204428 



Chronic obstructive pulmonary disease 



subjects, with the latter assuming symptomatic stability across 
these two observations (no confirmatory global assessment). 
Intraclass correlation coefficients (ICC), paired t tests and effect 
sizes were computed. 

Validity was examined by correlating E-RS scores with SGRQ 
total and domain scores, rescue medication use, clinician rating 
of dyspnoea on the mMRC, and forced expiratory volume in 
1 s (FEVi) % predicted. Known-groups validity was tested using 
Student t test, comparing E-RS scores of those with and without 
a medical diagnosis of chronic bronchitis (clinician-reported), 
current and former smokers (self-report), and those using no 
rescue medication versus three or more puffs (Day 1; self- 
report). Scores were also compared across clinician-rated disease 
severity, hypothesising weak relationships given the multidimen- 
sional nature of the clinician's assessment. To take this into 
account, analyses were performed with and without controlling 
for age, comorbidity status (<1 or >2) and FEVi. 

Statistical analyses were performed using SAS statistical soft- 
ware V9.1 (Cary, North Carolina, USA). 



RESULTS 
Samples 

Sample demographic and clinical characteristics by phase and 
stage are shown in table 1. 



Phase I: content validity 

Qualitative analyses identified three categories of respiratory 
symptoms patients experience when stable: breathlessness, 
cough and sputum, and chest symptoms. Representative quota- 
tions for each symptom category and the interrelationship/ 
co-occurrence of symptoms and the saturation grid are provided 
in online supplementary appendix tables SI and S2. 

Participants spoke of being 'breathless', 'short of breath', and 
having difficulty breathing, with severity levels that varied day 
to day. Cough and sputum were generally discussed together; 
most patients were unable to make it through the day without 
coughing. Sputum was characterised in terms of quantity and 
thickness. Most participants cited difficulty coughing up sputum 
or phlegm. Chest symptoms included congestion, tightness and 
discomfort, which also varied day to day. Participants often pre- 
sented their respiratory symptom descriptions as inter-related 
experiences, describing how they related to and affected one 
another. 

Content of the final instrument, in the context of the 14-item 
EXACT, is shown in online supplementary appendix table S3. 

Phase II: reliability and validity 

Item and factor analyses and scoring algorithm 

Participants used the full range of response options, with no 
missing data and minimal floor and ceiling effects. The CFA 



Table 1 Sample demographic and clinical characteristics by phase 




Phase I: content validity 




Phase II: score reliability 
& validity 


Characteristic 


Stage 1: secondary analysis 
of EXACT qualitative data* 
(n=63) 


Stage 2: new focus groupst 
(n=21) 


(n=188) 


Age mean (SD) 


65.2 (10.4) 


67.8 (8.7) 


65.8 (9.7) 


Male (%) 


28 (44.4) 


14 (66.7) 


91 (48.4) 


Smoking status, n (%) 








Current 


20 (31.7) 


9 (42.9) 


58 (30.9) 


Former 


42 (66.7) 


12 (57.1) 


130 (69.1) 


Duration of disease in years, mean (SD) 


7.9 (6.2) 


8.9 (7.3) 


7.5 (7.0) 


FEV, 


1.16 (0.4) 


1.3 (0.5) 


1 .3 (0.6) 


FEV,% predicted, mean (SD) 


45.8 (16.1) 


47.9 (16.6) 


51.2 (19.6) 


mMRC dyspnoea score, n (%) 








0 None 


1 (1.6) 


5 (23.8) 


1 5 (8.0) 


1 Hurrying uphill 


8 (12.7) 


8 (38.1) 


62 (33.0) 


2 Walks slower on level 


18 (28.6) 


3(14.3) 


56 (29.8) 


3 Stops after walking 


27 (42.9) 


4(19.0) 


49 (26.1) 


4 Too breathless 


6 (9.5) 


1 (4.8) 


6 (3.2) 


Missing 


3 (4.8) 


0 (0.0) 


0 (0.0) 


SGRQ total* 


56.3 (18.6) 


48.0 (16.0) 


50.8 (19.9) 


Symptoms 


64.3 (23.3) 


62.0 (23.1) 


60.8 (21.2) 


Activity 


72.6 (19.7) 


61.0 (21.0) 


69.7 (23.5) 


Impact 


45.7 (21.3) 


35.8 (16.4) 


36.8 (22.3) 


Patient-reported comorbidity, n (%)§ 








Hypertension 


21 (33.3) 


10 (47.6) 


73 (38.8) 


Diabetes 


12 (19.0) 


4(19.0) 


24 (12.8) 


Heart disease 


10 (15.9) 


1 (4.8) 


35 (18.6) 


Chronic sinusitis 


5 (7.9) 


2 (9.5) 


13 (6.9) 


Other 


16 (25.4) 


4(19.0) 


12 (6.4) 



*Three focus groups, twenty-five 1 : 1 interviews, two 2 : 1 interviews among stable COPD patients. 
tFour new focus groups. 

tPhase I, Stage 1: n=54-61; Phase II: n=181-188. 
§Not mutually exclusive. 

EXACT, Exacerbations of Chronic Pulmonary Disease Tool; FEVl forced expiratory volume in 1 s; GOLD, Global Initiative on Obstructive Lung Disease; mMRC, modified Medical Research 
Council; SGRQ, St. George's Respiratory Questionnaire. 
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Table 2 Exploratory factor analysis: promax factor loading* 



Item number 


Factor 3 


Factor 2 


Factor 1 


RS-Breathlessness 








Q7 — Breathless today 


0.777 


0.040 


0.056 


Q8 — Describe how breathless 


0.747 


0.122 


-0.170 


Q9 — Short of breath — personal care 


0.749 


0.103 


-0.053 


Q10 — Short of breath — indoor 


0.750 


-0.079 


0.081 


Q1 1 — Short of breath — outdoor 


0.644 


-0.154 


0.196 


RS-Cough & Sputum 








D? — How nftpn rnnnh 

1 IUVV Ul LCI 1 LUUU 1 


0.01 7 


0.717 


0.1 56 


Q3 — How much mucus when cough 


0.004 


0.850 


-0.082 


Q4 — Difficulty bringing up mucus 


0.071 


0.447 


0.284 


RS-Chest Symptoms 








Q1 — Chest feel congested 


0.006 


0.290 


0.575 


Q5 — Have chest discomfort 


-0.029 


-0.043 


0.876 


Q6— Chest feels tight 


0.113 


0.069 


0.622 



n=188. 

In bold: Factor 3: RS-Breathlessness; Factor 2: RS-Cough S Sputum, Factor 1; RS-Chest 
Symptoms. 

For each item, response scale scores range from 5 to 6, with higher scores reflecting 
greater severity. 

*X 2 =44.24 (DF=25), p=0.010; RMSEA=0.064, RMSR=0.027. 

RMSEA, root mean square error of approximation; RMSR, root mean square residual; 

RS, respiratory symptoms. 



confirmatory fit index (CFI) was 0.75, less than the 0.95 prespe- 
cified as a good fit for unidimensionality, thereby precluding the 
use of Rasch analysis for the total score. EFA showed a three- 
factor solution (table 2), indicating that three respiratory 
symptom subscales comprise the measure. The second-order 
factor model fit the data very well (CFI = 0.96), with standar- 
dised coefficients between the items and respiratory symptom 
factors, and between the respiratory symptom factors and the 
general factor, all greater than 0.60 (range 0.68 to 0.85 and 
0.65 to 0.95, respectively) (see figure 1). The 0.94 correlation 
between general factor and RS-Total scores provided further 
support for an empirical general factor governing the three 
E-RS factors. 



The scoring algorithms for the E-RS yield a total score and 
three subscale scores, with higher scores on these ordinal-level 
scales indicating more severe symptoms. Item-level scores range 
from 4 to 5 points (0 to 3 or 0 to 4), which are summed to 
yield total and subscale scores. E-RS scores are calculated for 
each day the diary is completed, and may be aggregated or sum- 
marised in a manner consistent with the study purpose and 
design. 

Descriptive statistics, floor and ceiling effects, total and sub- 
scale intercorrelations, and sample patient-level figures for 
RS-Total scores over 7 days are provided in online supplemen- 
tary appendix tables S4a and b and appendix figure SI. 

Reliability 

Reliability parameters are presented in table 3; reproducibility 
estimates for Days 1 to 2 are shown, with the remaining 
consecutive-day analyses appearing in online supplementary 
appendix table S5. 

Validity 

Correlations between E-RS scores and alternative assessments of 
respiratory symptom severity (concurrent validity), related con- 
structs (convergent validity), and weakly related constructs 
(divergent validity) are provided in table 4. 

RS-Total and subscale scores (RS-Breathlessness, RS-Cough & 
Sputum, and RS-Chest Symptoms) differentiated those with and 
without a diagnosis of chronic bronchitis, current and 
ex-smokers, and rescue medication free versus > three puffs 
(table 5). The univariate models of clinician-rated disease sever- 
ity were not significant, but the multivariate models for RS-Total 
(p<0.05), RS-Breathlessness (p < 0.05), and RS-Cough & 
Sputum scores (p < 0.01) were significant (see online supple- 
mentary appendix table S6). 

DISCUSSION 

Although respiratory symptoms play a key role in the diagnosis, 
assessment and management of patients with COPD and 
symptom relief is an important target of therapy, there is no 
standardised, reliable and valid daily diary for evaluating this 



.279 (.095) 



i.ooo (.ooo) ter^ 

v ' \Symptoms 



.284 (.060) 
.475 (.063) 
.502 (.066) 
.358 (.059) 
.408 (.062) 
.476 (.064) 
.308 (.052) 
.515 (.061) 
.410 (.057) 
.426 (.058) 
.543 (.061) 

Figure 1 Higher-Order Factor Model for the E-RS. Confirmatory Fit Index (CFI)=0.958. Root Mean Square Error of Approximation (RMSEA)=0.073 
(90% CI 0.050 to 0.096). Standardised Room Mean Square Residual (SRMR)=0.043. The E-RS is a derivative instrument, using the 11 respiratory 
symptom items from the 14-item EXACT. SOB, shortness of breath. 






2. Cough 


3. Mucus when coughing 






4. Difficulty with mucus 


». 

+ 


1 . Chest congested 


5. Chest discomfort 






6. Chest tight 




7. Breathless 


8. How breathless 






9. SOB with personal care 


». 


10. SOB with indoor 


1 1 . SOB with outdoor 
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Table 3 E-RS reliability: internal consistency and test-retest reproducibility 



Reproducibility (Day 1 and Day 2) 
(n=76)t 



Internal consistency (n=188) 

E-RS* Day 1 Day 2 Difference 

scale (# items) Cronbach's a ICCt mean (SD) mean (SD) (SD) p Value§ Effect size 



RS-Total Score (11) 


0.88 


0.90 


9.62 (6.24) 


9.66 (6.36) 


-0.04 (2.88) 


0.91 


-0.01 


RS-Breathlessness (5) 


0.86 


0.86 


5.07 (3.65) 


4.87 (3.63) 


0.20 (1.95) 


0.38 


0.05 


RS-Cough & Sputum (3) 


0.73 


0.87 


2.82 (2.30) 


2.88 (2.18) 


-0.07 (1.15) 


0.62 


-0.03 


RS-Chest Symptoms (3) 


0.81 


0.82 


1.74 (1.86) 


1.91 (2.07) 


-0.17 (1.18) 


0.21 


-0.09 






Reproducibility (Day 1 and Day 7) 












(n=171)H 












RS-Total Score 




0.73 


1 1 .9 (6.77) 


12.1 (7.22) 


-0.15 (5.14) 


0.70 


-0.02 


RS-Breathlessness 




0.71 


5.95 (3.75) 


6.09 (4.13) 


-0.15 (3.00) 


0.53 


-0.04 


RS-Cough & Sputum 




0.69 


3.51 (2.28) 


3.42 (1 .96) 


0.09 (1.67) 


0.49 


0.04 


RS-Chest Symptoms 




0.62 


2.45 (2.11) 


2.54 (2.27) 


-0.09 (1 .92) 


0.52 


-0.04 



'Ranges: RS-Total 0 to 40; RS-Breathlessness 0 to 17; RS-Cough & Sputum 0 to 11; RS-Chest Symptoms 0 to 12; higher scores=more severe symptoms, 
tlntraclass correlation coefficient. 

♦Participants reporting 'no change' between the two consecutive days. 
§p value from paired t test. 

TIParticipants completing the diary at Day 1 and Day 7. 

E-RS, Exacerbations of Chronic Pulmonary Disease Tool-Respiratory Symptoms; ICC, intraclass correlation coefficient. 



outcome in natural history studies and clinical trials. This paper 
presents the first evidence of the validity and reliability of the 
E-RS to meet this need. 

Phase I of this work addressed content validity. 10 28 
Participant descriptions of their breathlessness, cough and 
sputum were consistent with the literature 3 5 8 9 29 and the 
content and structure of the E-RS. Of particular note were 
descriptions of chest symptoms (chest congestion, discomfort 
and tightness), a symptom set not measured with existing ques- 

14-17 19 

tionnaires. 

Participant descriptions of symptom variability suggest an 
unstable component to 'stable' COPD, consistent with findings 
reported by Kessler et al 2 in severe patients. Of the symptom- 
atic patients participating in this pan-European observational 
study (70% of the 2441), most (63%) experienced symptom 
variability, with over half indicating variance throughout the 



Table 4 Validity: correlation with related constructs and 
alternative measures 



E-RS scalet 







Total 




Cough & 


Chest 


Measure 


n* 


score 


Breathlessness 


Sputum 


Symptoms 


SGRQ total 


181 


0.75*** 


0.69*** 


0.58*** 


0.52*** 


Symptoms 


188 


0.66*** 


0.44*** 


0.69*** 


0.60*** 


Activity 


184 


0.57*** 


0.68*** 


0.31*** 


0.26*** 


Impact 


181 


0.70*** 


0.61*** 


0.55*** 


0.54*** 


mMRC 


188 


0.33*** 


0.38*** 


0.24** 


0.16* 


Rescue 


188 


0.32*** 


0.34*** 


0.26** 


0.17* 


medication use 












FEV,% predicted 


188 


-0.10 


-0.17* 


-0.05 


0.01 



tSample sizes are a function of missing item-level data. 
tDay 1, Spearman's rank-order correlation. 

Bold coefficients identify related constructs with strongest expected value. 
*p<0.05; **p<0.001; ***p<0.0001. 

E-RS, Exacerbations of Chronic Pulmonary Disease Tool-Respiratory Symptoms; FEVl 
forced expiratory volume in 1 s; mMRC, modified Medical Research Council; SGRQ, 
St George's Respiratory Questionnaire. 



week (54%) or across seasons (60%). The most variable symp- 
toms were breathlessness and chest tightness; variability in 
breathlessness was associated with a history of two or more 
exacerbations the prior year and greater adverse impact on daily 
activity. 29 These results suggest respiratory symptoms in COPD 
may not be as stable as previously believed, 30 and that further 
research on day-to-day variability is needed. 

It is important to note that the E-RS is administered in the 
evening prior to bedtime with respondents rating their symp- 
toms as they reflect back on the day. This method is efficient 
and less burdensome than twice-daily assessments. However, 
this approach may be less precise for those interested in charac- 
terising and tracking nighttime or morning symptoms, specific- 
ally. 29 Studies could be performed to evaluate the added 
precision of administering the E-RS twice-daily, with the corre- 
sponding adjustment in recall period, or using a separate 
morning diary for this purpose. 

Participants described breathlessness, cough, sputum and 
chest congestion as co-occurring and interacting, suggesting a 
respiratory symptom complex in COPD that can be captured 
through a total score, representing the overall severity of this 
symptom complex, and subscale scores capturing the three types 
of respiratory symptoms. This was supported quantitatively in 
the second-order factor structure and strong interscale correla- 
tions, internal consistency reliability levels and validity metrics. 
This measurement structure permits step-down hypothesis 
testing, with respiratory symptom severity overall tested first, 
followed by tests for breathlessness, cough and sputum, and 
chest symptoms. 

Internal consistency estimates for RS-Total, RS-Breathlessness, 
and RS-Chest Symptom scores exceeded the conservative 0.80 
standard, indicating a high degree of precision with low meas- 
urement error. Score reproducibility over two consecutive days 
in patients reporting no change was very high. The lower esti- 
mates over a six-day interval (Day 1 and Day 7) are consistent 
with the known symptom variability day to day in stable 
patients. This finding is pertinent given regulatory authority 
interest in the use of daily symptom assessments 12 and the need 
for further study of symptom temporal-severity dynamics. 
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Table 5 Known-groups validity: E-RS Mean (SD) scores by chronic bronchitis diagnosis, smoking status, and rescue medication use 



Chronic bronchitis Smoking status Rescue medication uset 





Yes 


No 




Current smoker 


Ex-smoker 




3 or more puffs 


No 




E-RS scores* 


(n=51) 


(n=137) 


p Value* 


(n=58) 


(n=130) 


p Value! 


(n=5S) 


(n=94) 


p Value* 


RS-Total 


15.0 (6.2) 


10.8 (6.6) 


0.0001 


14.8 (6.8) 


10.6 (6.3) 


<0.0001 


14.7 (6.1) 


9.9 (6.3) 


<0.0001 


RS-Breathlessness 


7.3 (3.4) 


5.4 (3.7) 


0.0018 


6.9 (3.7) 


5.5 (3.6) 


0.0183 


7.6 (3.4) 


4.7 (3.4) 


<0.0001 


RS-Cough & Sputum 


4.5 (2.1) 


3.1 (2.2) 


0.0002 


4.7 (2.0) 


3.0 (2.2) 


<0.0001 


4.3 (2.0) 


3.0 (2.3) 


0.0009 


RS-Chest Symptoms 


3.2 (2.3) 


2.2 (2.0) 


0.0059 


3.2 (2.4) 


2.1 (1.9) 


0.0012 


2.9 (2.1) 


2.2 (2.1) 


0.0453 



*RS-Total and RS-domain score ranges are as follows with the higher values indicating greater severity of respiratory symptoms: RS-Total scores range from 0 to 40; RS-Breathlessness 
scores range from 0 to 1 7; RS-Cough & Sputum scores range from 0 to 1 1 ; and RS-Chest Symptoms scores range from 0 to 12. 
tStudy Day 1 . 
♦Student t test. 

E-RS, Exacerbations of Chronic Pulmonary Disease Tool-Respiratory Symptoms. 



The magnitude and pattern of correlations between health 
status (SGRQ), dyspnoea (mMRC), rescue medication use, and 
FEVi% and E-RS subscales were consistent with score validity. 
The chronic bronchitic phenotype and current smokers were 
more symptomatic, 32-34 while subjects who reported no rescue 
medication use on Day 1 also reported significantly less severe 
symptoms, with the strongest effect observed in the 
RS-Breathlessness scale. Although one might speculate that the 
relationship between symptom severity and the clinician's global 
assessment of COPD severity would be stronger, the modest 
relationship had improved power when confounding factors 
were controlled. This supports the differential and complemen- 
tary roles played by direct symptom assessment from the patient 
and the clinician's integrated assessment of the patient's COPD, 
with the latter including a clinical appraisal of symptoms, spir- 
ometry, physical assessment, exacerbation history, treatment 
history, comorbidity and general health, among other factors. 

Although the dataset did not permit an evaluation of sensitiv- 
ity to change, results of known-groups analyses offer prelimin- 
ary insight into score interpretation. For example, the difference 
in RS-Total scores between symptomatic and less symptomatic 
patients (table 5) was approximately 4 on the 40-point scale. 
Effect sizes were very large (>0.60), indicating that 4 points 
may be substantially greater than a 'minimally clinically import- 
ant difference' (MCID). Applying a commonly used 
distribution-based method for estimating the MCID (0.5 SD of 
the sample mean; online supplementary appendix table S4a), 
estimates would be: RS-Total: 3.35; RS-Breathlessness: 1.85; 
RS-Cough & Sputum: 1.15; RS-Chest Symptoms: 1.05. Until 
anchor-based estimates across multiple samples are available, 
these values should be considered preliminary since they are 
probably higher than the true MCID. 

Although respiratory symptoms may be assessed periodically 
as part of existing COPD-specific health status questionnaires, 
there are several potential advantages of daily assessments. First, 
daily scores reduce recall bias and provide a prospective, daily 
accounting of symptom severity. Second, this approach yields 
information on day-to-day variability. Third, daily data offer 
analytical flexibility, with methods for evaluation over time 
determined by the study purpose. Advantages of the E-RS spe- 
cifically include its embedded position within the EXACT, pro- 
viding data on exacerbations and respiratory symptoms 
simultaneously, with no additional patient burden. The EXACT 
was developed as an eDiary, with short, easy-to-read questions 
and recommendations for formatting and reminders to enhance 
compliance. Compliance rates were high (94%) in this short- 
term validation study, and have exceeded 88% across several 
3-6 month clinical trials, 24 suggesting eDiaries are feasible in 



this patient population. Widespread smart phone access may 
facilitate future testing and use of eDiaries in natural history 
studies or clinical practice. 35 

An important question is the suitability of the E-RS for inter- 
national studies. During the development of the parent instru- 
ment, international content and translation experts served on 
the advisory panel. To date, the EXACT has been translated into 
more than 50 languages with cognitive interviews conducted 
with COPD patients in the target countries to assure cultural 
and linguistic equivalence. Although the EXACT has performed 
well in international trials, 24 an evaluation of E-RS score reli- 
ability, validity and responsiveness in international settings is 
warranted. 

CONCLUSIONS 

The E-RS was designed to assess daily respiratory symptoms in 
clinical studies of COPD. Results suggest the instrument is 
content valid with quantitative evidence of score reliability and 
validity. Further research on the performance properties of E-RS 
scores in new samples and its sensitivity to change, including 
MCID estimation and development of responder definitions, are 
warranted. 
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